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The index notation 


Before we start with the main topic of this booklet, tensors, we will first introduce a 
new notation for vectors and matrices, and their algebraic manipulations: the index 
notation. It will prove to be much more powerful than the standard vector nota- 
tion. To clarify this we will translate all well-know vector and matrix manipulations 
(addition, multiplication and so on) to index notation. 

Let us take a manifold (=space) with dimension п. We will denote the compo- 
nents of a vector @ with the numbers v4,..., Un. If one modifies the vector basis, in 
which the components 01,..., Un of vector 7 are expressed, then these components 
will change, too. Such a transformation can be written using a matrix A, of which 
the columns can be regarded as the old basis vectors &, . . . , n expressed in the new 
basis &i^,.. ., €, , 

vi Au ct Аш\ (2% 
a] 3 : (1.1) 
Un An cc Am On 


Note that the first index of A denotes the row and the second index the column. In 
the next chapter we will say more about the transformation of vectors. 
According to the rules of matrix multiplication the above equation means: 








v = Aura + Am coco + Аи On, 
: : : : (1.2) 
On = Aerm + Ago + +++ + Ann: On, 
or equivalently, 
n 
01 = у Av, 
v=1 
(1.3) 
n 
Gë = у AnyUy , 
v=1 
or even shorter, 
n 
v, = } Aw vy (WHEN | 1<pK<n). (1.4) 
v=1 


In this formula we have put the essence of matrix multiplication. The index v is a 
dummy index and үи is a running index. The names of these indices, in this case и and 
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v, are chosen arbitrarily. The could equally well have been called « and f: 
n 
t=) Agog (WHEN | 1<a<n). (1.5) 
В=1 


Usually the conditions for и (in Eq. 1.4) or « (in Eq. 1.5) are not explicitly stated 
because they are obvious from the context. 
The following statements are therefore equivalent: 


T= у e On = Ун < Ua = Ул, 


п п (1.6) 
Ü = Ay = Ou = у Аруу» e Vy = L AvyuVyu e 
v=1 к= 


This index notation is also applicable to other manipulations, for instance the inner 
product. Take two vectors d and Ü, then we define the inner product as 


n 
T- Ü = mmm Horn = У vw. (17) 
u=l 


(We will return extensively to the inner product. Here it is just as an example of the 
power of the index notation). In addition to this type of manipulations, one can also 
just take the sum of matrices and of vectors: 


С=А+В © Cuv = Au + Buv 


P (1.8) 
2=0+0 > Za = Va + Ug 

or their difference, 
~ S Si = Cuv = Apv = Buy (1.9) 
Z=vU—-W e Za = Uy — Wy 


> Exercises 1 to 6 of Section C.1. 


From the exercises it should have become clear that the summation symbols ); 
can always be put at the start of the formula and that their order is irrelevant. We can 
therefore in principle omit these summation symbols, if we make clear in advance 
over which indices we perform a summation, for instance by putting them after the 
formula, 


n 
у AyyUy = Аш®» {v} 
=] 
И (1.10) 


п п 
D E AnpBeyCys — ^AgBeCs — (5v) 
В=1ү—1 


From the exercises one can already suspect that 


e almost never is a summation performed over an index if that index only ap- 
pears once in a product, 


almost always a summation is performed over an index that appears twice in 
a product, 


e an index appears almost never more than twice in a product. 
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When one uses index notation in every day routine, then it will soon become 
irritating to denote explicitly over which indices the summation is performed. From 
experience (see above three points) one knows over which indices the summations 
are performed, so one will soon have the idea to introduce the convention that, 
unless explicitly stated otherwise: 


e asummation is assumed over all indices that appear twice in a product, and 
e по summation is assumed over indices that appear only once. 


From now on we will write all our formulae in index notation with this particular 
convention, which is called the Einstein summation convection. For a more detailed 
look at index notation with the summation convention we refer to [4]. We will thus 
from now on rewrite 


n 
у Аруу = Аруу ` 
=1 
Ё (1.11) 


n n 
>; E Agent — AapBpyCys- 
p=17=1 


> Exercises 7 to 10 of Section C.1. 
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Bases, co- and contravariant vectors 


In this chapter we introduce a new kind of vector (‘covector’), one that will be es- 
sential for the rest of this booklet. To get used to this new concept we will first show 
in an intuitive way how one can imagine this new kind of vector. After that we will 
follow a more mathematical approach. 


2.1. Intuitive approach 


We can map the space around us using a coordinate system. Let us assume that 
we use a linear coordinate system, so that we can use linear algebra to describe 
it. Physical objects (represented, for example, with an arrow-vector) can then be 
described in terms of the basis-vectors belonging to the coordinate system (there 
are some hidden difficulties here, but we will ignore these for the moment). In 
this section we will see what happens when we choose another set of basis vectors, 
Le. what happens upon a basis transformation. 

In a description with coordinates we must be fully aware that the coordinates 
(i.e. the numbers) themselves have no meaning. Only with the corresponding basis 
vectors (which span up the coordinate system) do these numbers acquire meaning. 
It is important to realize that the object one describes is independent of the coordi- 
nate system (i.e. set of basis vectors) one chooses. Or in other words: an arrow does 
not change meaning when described an another coordinate system. 

Let us write down such a basis transformation, 


ё = аё + ane, 21) 
ER) => => Е 
€) = ane, + aye. 


This could be regarded as a kind of multiplication of a 'vector' with a matrix, as long 
as we take for the components of this 'vector' the basis vectors. If we describe the 
matrix elements with words, one would get something like: 


(2.2) 


ai _ (projection of & опію ё projection of Ou onto j| /z, 
ез! 2 | 


projection of ё’ onto ёр projection оЁ@›/ onto ё 


Note that the basis vector-colums () are not vectors, but just a very useful way to 


write things down. 
We can also look at what happens with the components of a vector if we use a 
different set of basis vectors. From linear algebra we know that the transformation 
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у=(04) у=(4) 

















е, ет 


Figure 2.1: The behaviour of the transformation of the components of a vector under 
the transformation of a basis vector 21' = Ae = v! 201. 


matrix can be constructed by putting the old basis vectors expressed in the new basis 
in the columns of the matrix. In words, 


(2 ) Е о of & onto ё’ projection of @ onto ё1' ) (2) Q3) 
0? \ртојесіоп of & onto &?' projection of & onto el / \02/ ` ) 
It is clear that the matrices of Eq. (2.2) and Eq. (2.3) are not the same. 

We now want to compare the basis-transformation matrix of Eq. (2.2) with the 
coordinate-transformation matrix of Eq. (2.3). To do this we replace all the primed 
elements in the matrix of Eq. (2.3) by non-primed elements and vice-versa. Compar- 
ison with the matrix in Eq. (2.2) shows that we also have to transpose the matrix. So 
if we call the matrix of Eq. (2.2) A, then Eq. (2.3) is equivalent to: 


v' = (A 1)Tg. (2.4) 


The normal vectors are called 'contravariant vectors', because they transform con- 
trary to the basis vector columns. That there must be a different behavior is also 
intuitively clear: if we described an 'arrow' by coordinates, and we then modify the 
basis vectors, then the coordinates must clearly change in the opposite way to make 
sure that the coordinates times the basis vectors produce the same physical ‘arrow’ 
(see Fig. ??). 

In view of these two opposite transformation properties, we could now attempt 
to construct objects that, contrary to normal vectors, transform the same as the basis 
vector columns. In the simple case in which, for example, the basis vector oul trans- 
forms into 5 х ё], the coordinate of this object must then also 1 times as large. This 
is precisely what happens to the coordinates of a gradient of a scalar function! The 
reason is that such a gradient is the difference of the function per unit distance in 
the direction of the basis vector. When this ‘unit’ suddenly shrinks (i.e. if the basis 
vector shrinks) this means that the gradient must shrink too (see Fig. ?? for a one- 
dimensional example). A 'gradient', which we so far have always regarded as a true 
vector, will from now on be called a ‘covariant vector’ or ‘covector’: it transforms in 
the same way as the basis vector columns. 

The fact that gradients have usually been treated as ordinary vectors is that if 
the coordinate transformation transforms one cartesian coordinate system into the 
other (or in other words: one orthonormal basis into the other), then the matrices A 
en (A71)? are the same. 


> Exercises 1, 2 of Section C.2. 


As long as one transforms only between orthonormal basis, there is no difference 
between contravariant vectors and covariant vectors. However, it is not always pos- 
sible in practice to restrict oneself to such bases. When doing vector mathematics in 


10 


2.2 Mathematical approach 


e 






grad F = -1.4 
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кюе 


Figure 2.2: Basis vector &' = 42; > Vf! = 


curved coordinate systems (like polar coordinates for example), one is often forced 
to use non-orthonormal bases. And in special relativity one is fundamentally forced 
to distinguish between co- and contravariant vectors. 


2.2. Mathematical approach 


Now that we have a notion for the difference between the transformation of a vector 
and the transformation of a gradient, let us have a more mathematical look at this. 

Consider an n-dimensional manifold with coordinates х], x5,..., Xn. We define 
the gradient of a function f(x, x, ..., Хп), 


m 
KREE? (2.5) 
The difference in transformation will now be demonstrated using the simplest of 
transformations: a homogeneous linear transformation (we did this in the previous 
section already, since we described all transformations with matrices). In general a 
coordinate transformation can also be non-homogeneous linear, (e.g. a translation), 
but we will not go into this here. 
Suppose we have a vector field defined on this manifold V : 2 = v(X). Let us 
perform a homogeneous linear transformation of the coordinates: 


Y» = AyvXv . (2.6) 


In this case not only the coordinates x, change (and therefore the dependence of 2 
on the coordinates), but also the components of the vectors, 


v, (X) m Аш о,(Х) ` (2.7) 


where A is the same matrix as in Eq. (2.6) (this may look trivial, but it is useful to 
check it! Also note that we take as transformation matrix the matrix that describes 
the transformation of the vector components, whereas in the previous section we 
took for А the matrix that describes the transformation of the basis vectors. So A is 
equal to (AV 

Now take the function Tim, x», ..., Xn) and the gradient w, at a point P in the 
following way, 


d 
Wy = -— Р (2.8) 


and in the new coordinate system as 


QU, СА : (2.9) 


EE: 
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It now follows (using the chain rule) that 











af _ af Am , Ar Ax Of Әх, po 
dr dä dr Ox;0xj °° Oan ƏXİ ` : 
That is, 
af (әх, \ af 
dr, (=) Ox, ' Fen) 


OXy 
w, = (=) шу. (2.12) 


This describes how a gradient transforms. One can regard the partial derivative a 
[Л 


Se 


as the matrix (A71)T where A is defined as in Eq. (2.6). To see this we first take the 
inverse of Eq. (2.6): 





х= (Аун. (2.13) 
Now take the derivative, 
Oxy _ DAE uo) _ (A71) dr, de (A wy (2 14) 
dr, ` d'r, Е ну Әх! duh "E ` 


Because in this case A does not depend on x; the last term on the right-hand side 
vanishes. Moreover, we have that 





dr, _ f 1 whenv =a, 
dr, — ди, ба = { 0 whenv # a. (2.15) 
Therefore, what remains is 
Ox - _ 
эу = (А71) иба = (Aya (2.16) 
a 
With Eq. (2.12) this yields for the transformation of a gradient 
w, = (А!) wv. (2.17) 
The indices are now in the correct position to put this in matrix form, 
ш' = (A) p (2.18) 


(We again note that the matrix A used here denotes the coordinate transformation 
from the coordinates x to the coordinates x’). 

We have shown here what is the difference in the transformation properties of 
normal vectors (‘arrows’) and gradients. Normal vectors we call from now on con- 
travariant vectors (though we usually simply call them vectors) and gradients we call 
covariant vectors (or covectors or one-forms). It should be noted that not every covari- 
ant vector field can be constructed as a gradient of a scalar function. A gradient has 
the property that V x (Vf) = 0, while not all covector fields may have this prop- 
erty. To distinguish vectors from covectors we will denote vectors with an arrow 
(9) and covectors with a tilde (@). To make further distinction between contravari- 
ant and covariant vectors we will put the contravariant indices (i.e. the indices of 
contravariant vectors) as superscript and the covariant indices (i.e. the indices of co- 
variant vectors) with subscripts, 


y* : contravariant vector 
Wa : covariant vector, or covector 
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2.2 Mathematical approach 


In practice it will turn out to be very useful to also introduce this convention for 
matrices. Without further argumentation (this will be given later) we note that the 
matrix A can be written as: 

A: А. (2.19) 


The transposed version of this matrix is: 
AT: A. (2.20) 


With this convention the transformation rules for vectors resp. covectors become 


v" = Alo’, (2.21) 
Wy = (ADT wy = (A wy. (2.22) 

The delta д of Eq. (2.15) also gets a matrix form, 
Ow — y. (2.23) 


This is called the ‘Kronecker delta’. It simply has the ‘function’ of ‘renaming’ an 
index: 
A yy" = y". (2.24) 
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Introduction to tensors 


Tensor calculus is a technique that can be regarded as a follow-up on linear algebra. 
It is a generalisation of classical linear algebra. In classical linear algebra one deals 
with vectors and matrices. Tensors are generalisations of vectors and matrices, as 
we will see in this chapter. 

In section 3.1 we will see in an example how a tensor can naturally arise. In 
section 3.2 we will re-analyse the essential step of section 3.1, to get a better under- 
standing. 


3.1. The new inner product and the first tensor 


The inner product is very important in physics. Let us consider an example. In 
classical mechanics it is true that the ^work' that is done when an object is moved 
equals the inner product of the force acting on the object and the displacement vector 
x, 

Welk: (3.1) 


The work W must of course be independent of the coordinate system in which the 
vectors F and X are expressed. The inner product as we know it, 


s = (1,0) = a"b" (old definition) (3.2) 
does not have this property in general, 
s = (Ab) = Al a" A gb? = LAT, AP ga? D , (3.3) 


where А is the transformation matrix. Only if A^ equals AT (i.e. if we are dealing 
with orthonormal transformations) s will not change. The matrices will then together 
form the kronecker delta óg,. It appears as if the inner product only describes the 
physics correctly in a special kind of coordinate system: a system which according to 
our human perception is ‘rectangular’, and has physical units, i.e. a distance of 1 in 
coordinate x; means indeed 1 meter in xj-direction. An orthonormal transformation 
produces again such a rectangular ‘physical’ coordinate system. If one has so far 
always employed such special coordinates anyway, this inner product has always 
worked properly. 

However, as we already explained in the previous chapter, it is not always guar- 
anteed that one can use such special coordinate systems (polar coordinates are an 
example in which the local orthonormal basis of vectors is not the coordinate basis). 
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3.1 The new inner product and the first tensor 


The inner product between a vector x and a covector y, however, is invariant 
under all transformations, 
5 = yy, (3.4) 
because for all A one can write 
s = lm = Alax" (A78 ув = LAT AP x^ yg = дб хур =s (35) 


With help of this inner produce we сап introduce а new inner product between 
two contravariant vectors which also has this invariance property. To do this we 
introduce a covector "pu and define the inner product between x! and y" with respect 
to this covector w, in the following way (we will introduce a better definition later): 

5 = wywyX"y" (first attempt) (3.6) 
(Warning: later it will become clear that this definition is not quite useful, but at 
least it will bring us on the right track toward finding an invariant inner product be- 
tween two contravariant vectors). The inner product s will now obviously transform 
correctly, because it is made out of two invariant ones, 


ð= (А1) w,(A T)" gm, A" px? AP oy” 
= (ATK A* (ACD ad angst 


= Gl go" gwywyx" y" (3.7) 


= wywyx"y" 


= 5. 


We have now produced an invariant 'inner product' for contravariant vectors by 
using a covariant vector w, as a measure of length. However, this covector appears 
twice in the formula. One can also rearrange these factors in the following way, 


1 


001 `0] 01:025 Wi: WZ V 
s = (wywy)x y" = (xl x? х3) | ww mam w;:was||yl. (38) 
W3: Wi 3-12 3-3 y? 


In this way the two appearances of the covector w are combined into one object: 
some kind of product of w with itself. It is some kind of matrix, since it is a collection 
of numbers labeled with indices и and v. Let us call this object g, 


Wi: U 01:02 Ui: Wz 811 812 813 
g= |w: w, WoW ш :из | = | 82 g2 gz]. (3.9) 
Шз Wi 3:02 "a: W3 831 832 933 


Instead of using a covector w, in relation to which we define the inner product, 
we can also directly define the object g: that is more direct. So, we define the inner 
product with respect to the object g as: 


new definition (3.10) 


Now we must make sure that the object g is chosen such that our new inner product 
reproduces the old one if we choose an orthonormal coordinate system. So, with 
Ед. (3.8) in an orthonormal system one should have 


5 = gux y" 


811 812 813 у! 
x)|£ g2 $з||у7 (3.11) 
$31 832 833 y? 


= xly! 4 х2? + х?у? іп an orthonormal system! 
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3.2 Creating tensors from vectors 


To achieve this, g must become, in an orthonormal system, something like a unit 
matrix: 


100 
gw = |0 1 0 in an orthonormal system! (3.12) 
0.0 1 


One can see that one cannot produce this set of numbers according to Eq. (3.9). 
This means that the definition of the inner product according to Eq. (3.6) has to be 
rejected (hence the warning that was written there). Instead we have to start directly 
from Eq. (3.10). We do no longer regard g as built out of two covectors, but regard it 
as a matrix-like set of numbers on itself. 

However, it does not have the transformation properties of a classical matrix. 
Remember that the matrix А of the previous chapter had one index up and one 
index down: A“, indicating that it has mixed contra- and co-variant transformation 
properties. The new object guy, however, has both indices down: it transforms in 
both indices in a covariant way, like the тиш, which we initially used for our inner 
product. This curious object, which looks like a matrix, but does not transform as 
one, is an example of a tensor. A matrix is also a tensor, as are vectors and covectors. 
Matrices, vectors and covectors are special cases of the more general class of objects 
called ‘tensors’. The object gy is a kind of tensor that is neither a matrix nor a vector 
or covector. Itis a new kind of object for which only tensor mathematics has a proper 
description. 

The object g is called a metric, and we will study its properties later in more 
detail: in Chapter 5. 

With this last step we now have a complete description of the new inner product 
between contravariant vectors that behaves properly, in that it remains invariant 
under any linear transformation, and that it reproduces the old inner product when 
we work in an orthonormal basis. So, returning to our original problem, 


W = (Ё, X) = Ех” general formula. (3.13) 


In this section we have in fact put forward two new concepts: the new inner 
product and the concept of a ‘tensor’. We will cover both concepts more deeply: the 
tensors in Section 3.2 and Chapter 4, and the inner product in Chapter 5. 


3.2. Creating tensors from vectors 


In the previous section we have seen how one can produce a tensor out of two 
covectors. In this section we will revisit this procedure from a slightly different 
angle. 

Let us look at products between matrices and vectors, like we did in the previous 
chapters. One starts with an object with two indices and therefore n? components 
(the matrix) and an object with one index and therefore п components (the vector). 
Together they have n° + п componenten. After multiplication one is left with one 
object with one index and п components (a vector). One has therefore lost (n? + 
п) — n = п? numbers: they are 'summed away’. A similar story holds for the inner 
product between a covector and a vector. One starts with 2n components and ends 
up with one number, 

5 = Hu = lm + х2у2 + хуз. (3.14) 


Summation therefore reduces the number of components. 

In standard multiplication procedures from classical linear algebra such a sum- 
mation usually takes place: for matrix multiplications as well as for inner products. 
In index notation this is denoted with paired indices using the summation conven- 
tion. However, the index notation also allows us to multiply vectors and covectors 
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3.2 Creating tensors from vectors 


without pairing up the indices, and therefore without summation. The object one 
thus obtains does not have fewer components, but тоте: 


zm x.y sm 
shy = äi = |х?-уу xa xs]. (3.15) 
xy x3 yo X? - ys 


We now did not produce one number (as we would have if we replaced v with p in 
the above formula) but instead an ordered set of numbers labelled with the indices и 
and v. So if we take the example ¥ = (1,3,5) and ӯ = (4,7,6), then the tensor- 
components of a, are, for example: 523 = x? - уз = 3.6 = 18 and s, = x! -yı = 
1-4 — 4, and so on. 

This is the kind of 'tensor' object that this booklet is about. However, this ob- 
ject still looks very much like a matrix, since a matrix is also nothing more or less 
than a set of numbers labeled with two indices. To check if this is a true matrix or 
something else, we need to see how it transforms, 


s^ = typ = Apr (AT) gyv = A*Q(A T)" gx yy) = А (A )"gs y. (3.16) 


» Exercise 2 of Section C.3. 


If we compare the transformation in Eq.(3.16) with that of a true matrix of ex- 
ercise 2 we see that the tensor we constructed is indeed an ordinary matrix. But if 
instead we use two covectors, 


mn Xi: V2 Xi: V3 
tuv = Xyyv = | хоу X2cy2 X2: ys]; (3.17) 
X3°Y1 %3:Y2 rar Ma 


then we get a tensor with different transformation properties, 
tap = Xap = LAT x (AT) ву, 
= (AD (А1) g(xuyv) (3.18) 
= (ARA р. 


The difference with s", lies in the first matrix of the transformation equation. For s 
it is the transformation matrix for contravariant vectors, while for t it is the trans- 
formation matrix for covariant vectors. The tensor t is clearly not a matrix, so we 
indeed created something new here. The g tensor of the previous section is of the 
same type as f. 

The beauty of tensors is that they can have an arbitrary number of indices. One 
can also produce, for instance, a tensor with 3 indices, 


Anpy = Xay pzy . (3.19) 


This is an ordered set of numbes labeled with three indices. It can be visualized as a 
kind of ‘super-matrix’ in 3 dimensions (see Fig. 22). 

These are tensors of rank 3, as opposed to tensors of rank 0 (scalars), rank 1 
(vectors and covectors) and rank 2 (matrices and the other kind of tensors we in- 
troduced so far). We can distinguish between the contravariant rank and covariant 
rank. Clearly Aggy is a tensor of covariant rank З and contravariant rank 0. Its to- 
tal rank is 3. One can also produce tensors of, for instance, contravariant rank 2 
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3.2 Creating tensors from vectors 
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Figure 3.1: A tensor of rank 3. 


and covariant rank 3 (i.e. total rank 5): BoP uvo: A similar tensor, C^ куф” ‚ is also of 
contravariant rank 2 and covariant rank 3. Typically, when tensor mathematics is 
applied, the meaning of each index has been defined beforehand: the first index 
means this, the second means that etc. As long as this is well-defined, then one can 
have co- and contra-variant indices in any order. However, since it usually looks bet- 
ter (though this is a matter of taste) to have the contravariant indices first and the 
covariant ones last, usually the meaning of the indices is chosen in such a way that 
this is accomodated. This is just a matter of how one chooses to assign meaning to 
each of the indices. 

Again it must be clear that although a multiplication (without summation!) of т 
vectors and т covectors produces a tensor of rank m + n, not every tensor of rank m + 
n can be constructed as such a product. Tensors are much more general than these 
simple products of vectors and covectors. It is therefore important to step away 
from this picture of combining vectors and covectors into a tensor, and consider this 
construction as nothing more than a simple example. 
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3.2 Creating tensors from vectors 
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Tensors, definitions and properties 


Now that we have a first idea of what tensors are, it is time for a more formal de- 
scription of these objects. 

We begin with a formal definition of a tensor in Section 4.1. Then, Sections 4.2 
and 4.3 give some important mathematical properties of tensors. Section 4.4 gives 
an alternative, in the literature often used, notation of tensors. And finally, in Sec- 
tion 4.5, we take a somewhat different view, considering tensors as operators. 


4.1. Definition of a tensor 


‘Definition’ of a tensor: An (N, M)-tensor at a given point in space can be described 
by a set of numbers with N -- M indices which transforms, upon coordinate trans- 
formation given by the matrix A, in the following way: 





pus is = AM es? AN (AT, 


СА рм Pm al (n 


An (№, M)-tensor in a three-dimensional manifold therefore has 3 * M) compo- 
nents. Itis contravariant in N components and covariant in M components. Tensors 
of the type 


ui (4.2) 


are of course not excluded, as they can be constructed from the above kind of tensors 
by rearrangement of indices (like the transposition of a matrix as in Eq. 2.20). 


Matrices (2 indices), vectors and covectors (1 index) and scalars (0 indices) are 
therefore also tensors, where the latter transforms as s’ = s. 


4.2. Symmetry and antisymmetry 


In practice it often happens that tensors display a certain amount of symmetry, like 
what we know from matrices. Such symmetries have a strong effect on the proper- 
ties of these tensors. Often many of these properties or even tensor equations can be 
derived solely on the basis of these symmetries. 

A tensor Ё is called symmetric in the indices и and v if the components are equal 
upon exchange of the index-values. So, for a 2nd rank contravariant tensor, 


py {Р symmetric (2,0)-tensor . (4.3) 
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4.4 Tensors as geometrical objects 


A tensor t is called anti-symmetric in the indices и and v if the components are equal- 
but-opposite upon exchange of the index-values. So, for a 27% rank contravariant 
tensor, 

pv pr anti-symmetric (2,0)-tensor. (4.4) 


It is not useful to speak of symmetry or anti-symmetry in a pair of indices that are 
not of the same type (co- or contravariant). The properties of symmetry only remain 
invariant upon basis transformation if the indices are of the same type. 


» Exercises 2 and 3 of Section C.4. 


4.3. Contraction of indices 


With tensors of at least one covariant and at least one contravariant index we can 
define a kind of ‘internal inner product’. In the simplest case this goes as, 


f^ (4.5) 


where, as usual, we sum over «. This is the trace of the matrix t^ f: Also this con- 
struction is invariant under basis transformations. In classical linear algebra this 
property of the trace of a matrix was also known. 


> Exercise З of Section CA. 


One can also perform such a contraction of indices with tensors of higher rank, but 
then some uncontracted indices remain, e.g. 


pb, = об, (4.6) 


In this way we can convert a tensor of type (N, M) into a tensor of type (N — 1, M — 
1). Of course, this contraction procedure causes information to get lost, since after 
the contraction we have fewer components. 

Note that contraction can only take place between one contravariant index and 
one covariant index. A contraction like Hi is not invariant under coordinate trans- 
formation, and we should therefore reject such constructions. In fact, the summa- 
tions of the summation convention only happen over a covariant and a contravariant 
index, be it a contraction of a tensor (like ¢/“,) or an inner product between two ten- 
sors (like Руа). 


4.4. Tensors as geometrical objects 


Vectors can be seen as columns of numbers, but also as arrows. One can perform 
calculations with these arrows if one regards them as linear combinations of 'basis 
arrows', 


T=} ë. (4.7) 
H 
We would like to do something like this also with covectors and eventually of course 


with all tensors. For covectors it amounts to constructing a set of ‘unit covectors' that 
serve as a basis for the covectors. We write 


d = A wg А (4.8) 
H 


Note: we denote the basis vectors and basis covectors with indices, but we do not 
mean the components of these basis (co-)vectors (after all: in which basis would that 


22 


4.4 Tensors as geometrical objects 


be?). Instead we label the basis (co-)vectors themselves with these indices. This way 
of writing was already introduced in Section 2.1. In spite of the fact that these indices 
have therefore a slightly different meaning, we still use the usual conventions of 
summation for these indices. Note that we mark the co-variant basis vectors with 
an upper index and the contra-variant basis-vectors with a lower index. This may 
sound counter-intuitive (‘did we not decide to use upper indices for contra-variant 
vectors? but this is precisely what we mean with the ‘different meaning of the 
indices’ here: this time they label the vectors and do not denote their components. 

The next step is to express the basis of covectors in the basis of vectors. To do this, 
let us remember that the inner product between a vector and a covector is always 
invariant under transformations, independent of the chosen basis: 


T- Ü = ош, (4.9) 


We now substitute Eq. (4.7) and Eq. (4.8) into the left hand side of the equation, 


> 


@-@ = vE: wpe . (4.10) 
If Eq. (4.9) and Eq. (4.10) have to remain consistent, it automatically follows that 
ae, dÉ (411) 


On the left hand side one has the inner product between a covector ёё and a vec- 
tor &. This time the inner product is written in abstract form (i.e. not written out 
in components like we did before). The indices д and P simply denote which of 
the basis covectors (В) is contracted with which of the basis vectors (д). A geomet- 
rical representation of vectors, covectors and the geometric meaning of their inner 
product is given in appendix B. 

Eq. (4.11) is the (implicit) definition of the co-basis in terms of the basis. This 
equation does not give the co-basis explicitly, but it defines it nevertheless uniquely. 
This co-basis is called the ‘dual basis’. By arranging the basis covectors in columns 
as in Section 2.1, one can show that they transform as 


SR Au, (4.12) 
when we choose A (that was equal to (A-1)P) in such a way that 
d = ((А71)1), gs. (413) 


In other words: basis-covector-columns transform as vectors, in contrast to basis- 
vector-columns, which transform as covectors. 

The description of vectors and covectors as geometric objects is now complete. 
We can now also express tensors in such an abstract way (again here we refer to 
the mathematical description; a geometric graphical depiction of tensors is given in 
appendix B). We then express these tensors in terms of 'basis tensors'. These can be 
constructed from the basis vectors and basis covectors we have constructed above, 


t= Н ёр @& OE. (4.14) 


The operator & is the ‘tensor outer product’. Combining tensors (in this case the 
basis (co-)vectors) with such an outer product means that the rank of the resulting 
tensor is the sum of the ranks of the combined tensors. It is the geometric (abstract) 
version of the ‘outer product’ we introduced in Section 3.2 to create tensors. The 
operator ® is not commutative, 


üobzboi. (4.15) 
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4.5 Tensors as operators 


4.5. Tensors as operators 
Let us revisit the new inner product with v a vector and w a covector, 
wav" = s. (4.16) 
If we drop index notation and we use the usual symbols we have, 
00 = 5, (4.17) 


This could also be written as 
(T) =s, (4.18) 


where the brackets mean that the covector @ acts on the vector 2. In this way, @ is an 
operator (a function) which 'eats' a vector and produces a scalar. Therefore, written 
in the usual way to denote maps from one set to another, 


d: Е" В. (4.19) 


A covector is then called a linear ‘function of direction’: the result of the operation 
(Le. the resulting scalar) is linearly dependent on the input (the vector), which is a 
directional object. We can also regard it the other way around, 


(v) =. (4.20) 


where the vector is now the operator and the covector the argument. To prevent 
confusion we write Eq. (4.19) from now on in a somewhat different way, 


B — К. (4.21) 


S 


An arbitrary tensor of rank (N, M) can also be regarded in this way. The tensor 
has as input a tensor of rank (M, N), or the product of more than one tensors of 
lower rank, such that the number of contravariant indices equals M and the number 
of covariant indices equals N. After contraction of all indices we obtain a scalar. 
Example (for a (2, 1)-tensor), 

HP, a bgc? = 5. (4.22) 


The tensor t can be regarded as a function of 2 covectors (a ап b) and 1 vector (с), 
which produces a real number (scalar). The function is linearly dependent on its 
input, so that we can call this a ^multilinear function of direction'. This somewhat 
complex nomenclature for tensors is mainly found in older literature. 

Of course the fact that tensors can be regarded to some degree as functions or 
operators does not mean that it is always useful to do so. In most applications 
tensors are considered as objects themselves, and not as functions. 
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The metric tensor and the new inner 
product 


In this chapter we will go deeper into the topic of the new inner product. The new 
inner product, and the metric tensor g associated with it, is of great importance to 
nearly all applications of tensor mathematics in non-cartesian coordinate systems 
and/or curved manifolds. It allows us to produce mathematical and physical for- 
mulae that are invariant under coordinate transformations of any kind. 

In Section 5.1 we will give an outline of the role that is played by the metric 
tensor g in geometry. Section 5.2 covers the properties of this metric tensor. Finally, 
Section 5.3 describes the procedure of raising or lowering an index using the metric 
tensor. 


5.1. The metric as a measuring rod 


If one wants to describe a physical system, then one typically wants to do this with 
numbers, because they are exact and one can put them on paper. To be able to do this 
one must first define a coordinate system in which the measurements can be done. 
One could in principle take the coordinate system in any way one likes, but often 
one prefers to use an orthonormal coordinate system because this is particularly 
practical for measuring distances using the law of Pythagoras. 

However, often it is not quite practical to use such cartesian coordinates. For 
systems with (nearly) cylindrical symmetry or (nearly) spherical symmetry, for in- 
stance, it is much more practical to use cylindrical or polar coordinates, even though 
one could use cartesian ones. In some applications it is even impossible to use or- 
thonormal coordinates, for instance in the case of mapping of the surface of the 
Earth. In a typical projection of the Earth with meridians vertically and parallels 
horizontally, the northern countries are stretched enormously and the north/south 
pole is a line instead of a point. Measuring distances (or the length of a vector) on 
such a map with Pythagoras would produce wrong results. 

What one has to do to get an impression of 'true' distances, sizes and propor- 
tions is to draw on various places on the Earth-map a 'unit circle' that represents, 
say, 100 km in each direction (if we wish to measure distances in units of 100 km). 
At the equator these are presumably circles, but as one goes toward the pole they 
tend to become ellipses: they are circles that are stretched in horizonal (east-west) 
direction. At the north pole such a ‘unit circle’ will be stretched infinitely in hori- 
zontal direction. There is a strong relation between this unit circle and the metric g. 
In appendix B one can see that indeed a metric can be graphically represented with 
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5.2 Properties of the metric tensor 


a unit circle (in 2-D) or a unit sphere (in 3-D). 

So how does one measure the distance between two points on such a curved 
manifold? In the example of the Earth's projection one sees that q is different at dif- 
ferent lattitudes. So if points A and B have different lattitudes, there is no unique g 
that we can use to measure the distance. Indeed, there is no objective distance that 
one can give. What what can do is to define a path from point A to point B and mea- 
sure the distance along this path in little steps. At each step the distance travelled is 
so small that one can take the g at the middle of the step and get a reasonably good 
estimate of the length ds of that step. This is given by 


ds? = И with Zw. (5.1) 


By integrating ds all the way from A to B one thus obtains the distance along this 
path. Perhaps the ‘true’ distance is then the distance along the path which yields the 
shortest distance between these points. 

What we have done here is to chop the path into such small bits that the curva- 
ture of the Earth is negligible. Within each step g changes so little that one can use 
the linear expressions for length and distance using the local metric g. 

Let us take a bit more concrete example and measure distances in 3-D using 
polar coordinates. From geometric considerations we know that the length dl of an 
infinitesimally small vector at position (r, 0, p) in polar coordinates satisfies 


d? = s = dr? +240? + г25іп20аф2. (5.2) 
We could also write this as 


1 0 0 dx! 
а? =в=(ах! de uda po 0 dx? | = ах”ах”. — (5.8) 
0 0 r?sin?0/ \ах? 


All the information about the concept of ‘length’ or ‘distance’ is hidden in the metric 
tensor g. The metric tensor field g(X) is usually called the ‘metric of the manifold’. 


5.2. Properties of the metric tensor 


The metric tensor g has some important properties. First of all, it is symmetric. This 
can be seen in various ways. One of them is that one can always find a coordinate 
system in which, locally, the metric tensor has the shape of a unit ^matrix', which is 
symmetric. Symmetry of a tensor is conserved upon any transformation (see Sec- 
tion 4.2). Another way to see it is that the inner product of two vectors should not 
depend on the order of these vectors: уюш” = „уш'ш! = gyyv"w" (in the last 
step we renamed the running indices). 

Every symmetric second rank covariant tensor can be transformed into diagonal 
form in which the diagonal elements are either 1,0 or —1. For the metric tensor they 
will then all be 1: in an orthonormal coordinate system. In fact, an orthonormal 
coordinate system is defined as the coordinate system in which gy, = diag(1, 1, 1). 
A normal metric can always be put into this form. However, mathematically one 
could also conceive a manifold that has a metric that can be brought into the follow- 
ing form: guy = diag(1,1, —1). This produces funny results for some vectors. For 
instance, the vector (0,0, 1) would have an imaginary length, and the vector (0, 1,1) 
has length zero. These are rather pathological properties and appear to be only in- 
teresting to mathematicians. A real metric, after all, should always produce positive 
definite lengths for vectors unequal to the zero-vector. However, as one can see in 
appendix A, in special relativity a metric will be introduced that can be brought to 
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the form diag(—1, 1,1, 1). For now, however, we will assume that the metric is posi- 
tive definite (i.e. can be brought to the form gj, = diag(1, 1,1) through a coordinate 
transformation). 

It should be noted that a metric of signature gu, = diag(1,1, —1) can never be 
brought into the form guv = diag(1,1,1) by coordinate transformation, and vice 
versa. This signature of the metric is therefore an invariant. Normal metrics have 
signature diag(1, 1, 1). This does not mean that they are Suv = diag(1, 1, 1), but they 
can be brought into this form with a suitable coordinate transformation. 


> Exercise 1 of Section C.5. 


So what about the inner product between two co-vectors? Just as with the vectors 
we use a kind of metric tensor, but this time of contravariant nature: g”. The inner 


product then becomes 
Exc sa 


The distinction between these two metric tensors is simply made by upper resp. lower 
indices. The properties we have derived for gu of course also hold for 2"". And both 
metrics are intimitely related: once guy is given, g"" can be constructed and vice 
versa. In a sense they are two realisations of the same metric object g. The easiest 
way to find o! from gj, is to find a coordinate system in which guy = diag(1, 1,1): 
then ai! is also equal to diag(1, 1, 1). But in the next section we will derive a more 
elegant relation between the two forms of the metric tensor. 


5.3. Co versus contra 


Before we got introduced to co-vectors we presumably always used orthonormal 
coordinate systems. In such coordinate systems we never encountered the differ- 
ence between co- and contra-variant vectors. A gradient was simply a vector, like 
any kind of vector. An example is the electric field. One can regard an electric field 


as a gradient, 
oV 








On the other hand it is clearly also an arrow-like object, related to a force, 
E= ip = Laz < E” Zo T ndi, (5.6) 
q q q q 


In an orthonormal system one can interchange R and Ё (or equivalently E” and Еи) 
without punishment. But as soon as we go to a non-orthonormal system, we will 
encounter problems. Then one is suddenly forced to distinguish between the two. 
So the question becomes: if one has a potential field V, how does one obtain the 
contravariant E? Perhaps the most obvious solution is: first produce the covariant 
tensor E, then transform to an orthonormal system, then switch from co-vector form 
to contravariant vector form (in this system their components are identical, at least 
for a positive definite metric) and then transform back to the original coordinate 
system. This is possible, but very time-consuming and unwieldy. A better method 
is to use the metric tensor: 
EF = o" Ey: (5.7) 


This is a proper tensor product, as the contraction takes place over an upper and a 
lower index. The object E”, which was created from Ey is now contravariant. One 
can see that this vector must indeed be the contravariant version of E, by taking an 
orthonormal coordinate system: here gy, = diag(1, 1, 1), i.e. guv is some kind of unit 
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5.8 Co versus contra 


5.3 Co versus contra 


‘matrix’. This is the same as saying that in the orthonormal basis E" = Ey, which is 
indeed true (again, only for a metric that can be diagonalised to diag(1, 1,1), which 
for classical physics is always the case). However, in contrast to the formula E" — 
Бу, the formula Eq. (5.7) is now also valid after transformation to any coordinate 
system, 
(A "DP En = (A^, (A TD" gu. AP E" 

SAN GEE (5.8) 

= (ATE) gy, E" , 
(here we introduced c to avoid having four v symbols, which would conflict with 
the summation convention). If we multiply on both sides with A*, we obtain exactly 


(the index p can be of course replaced by и) Eq. (5.7). 
One can of course also do the reverse, 


En = gy E". (5.9) 


If we first lower an index with gyp, and then raise it again with g™”, then we must 
arrive back with the original vector. This results in a relation between gy, en $, 








E" — g Ey = g” gus Ef ô E? EN g” Sug — die (5.10) 


With this relation we have now defined the contravariant version of the metric ten- 
sor in terms of its covariant version. 

We call the conversion of a contravariant index into a covariant one "lowering an 
index", while the reverse is "raising an index". The vector and its covariant version 
are each others "dual". 
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Tensor calculus 


Now that we are familiar with the concept of 'tensor' we need to go a bit deeper in 
the calculus that one can do with these objects. This is not entirely trivial. The index 
notation makes it possible to write all kinds of manipulations in an easy way, but 
makes it also all too easy to write down expressions that have no meaning or have 
bad properties. We will need to investigate where these pitfalls may arise. 

We will also start thinking about differentiation of tensors. Also here the rules of 
index notation are rather logical, but also here there are problems looming. These 
problems have to do with the fact that ordinary derivatives of tensors do no longer 
transform as tensors. This is a problem that has far-reaching consequences and we 
will deal with them in Chapter 7. For now we will merely make a mental note of 
this. 

At the end of this chapter we will introduce another special kind of tensor, the 
Levi-Civita tensor, which allows us to write down cross-products in index notation. 
Without this tensor the cross-product cannot be expressed in index notation. 


6.1. The 'covariance' of equations 


In chapter 3 we saw that the old inner product was not a good definition. It said 
that the work equals the (old) inner product between F en X. However, while the 
work is a physical notion, and thereby invariant under coordinate transformation, 
the inner product was not invariant. In other words: the equation was only valid in 
a prefered coordinate system. After the introduction of the new inner product the 
equation suddenly kept its validity in any coordinate system. We call this ‘universal 
validity’ of the equation: ‘covariance. Be careful not to confuse this with ‘covariant 
vector’: it is a rather unpractical fate that the word 'covariant' has two meanings 
in tensor calculus: that of the type of index (or vector) on the one hand and the 
"universal validity' of expressions on the other hand. 
The following expressions and equations are therefore covariant, 


Xy = Yu, (6.1) 
Хх! = y", (6.2) 


because both sides transform in the same way. The following expression is not co- 


variant: 
Xy = y", (6.3) 


because the left-hand-side transforms as a covector (i.e. with LA" TV and the right- 
hand-side as a contravariant vector (i.e. with A). If this equation holds by chance in 
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6.2 Addition of tensors 


one coordinate system, then it will likely not hold in another coordinate system. 
Since we are only interested in vectors and covectors are geometric objects and not 
in their components in some arbitrary coordinate system, we must conclude that 
covectors cannot be set equal to contravariant vectors. 

The same as above we can say about the following equation, 


tuv = s, Я (6.4) 


This expression is also not covariant. The tensors on both sides of the equal sign are 
of different type. 

If we choose to stay in orthonormal coordinates then we can drop the distinction be- 
tween co- and contra-variant vectors and we do not need to check if our expressions 
or equations are covariant. In that case we put all indices as subscript, to avoid 
giving the impression that we distinguish between co- and contravariant vectors. 


6.2. Addition of tensors 


Two tensors can only be added if they have the same rank: one cannot add a vector 
to a matrix. Addition of two equal-rank tensors is only possible if they are of the 
same type. So 

о” + wy (6.5) 


is not a tensor. (The fact that the index и occurs double here does not mean that 
they need to be summed over, since according to the summation convention one 
only sums over equal indices occuring in a product, not in a sum. See chapter 1). If 
one adds two equal type tensors but with unequal indices one gets a meaningless 
expression, 

Uy + Uy. (6.6) 


If tensors are of the same type, one can add them. One should then choose the indices 
to be the same, 


X" pg. (6.7) 


ог 
en Ke (6.8) 


Both the above expressions are exactly the same. We just chose и and v as the indices 
in the first expression and « and p in the second. This is merely a matter of choice. 
Now what about the following expression: 


gr SC Se ; (6.9) 


Both tensors are of same rank, have the same number of upper and lower indices, 
but their order is different. This is a rather peculiar contruction, since typically (as 
mentioned before) one assigns meaning to each index before one starts working 
with tensors. Evidently the meaning assigned to index 2 is different in the two 
cases, since in the case of t^ DM it is a covariant index while in the case of r^* B it is 
a contravariant index. But this expression, though highly confusing (and therefore 
not recommendable) is not formally wrong. One can see this if one assumes that 
тр = u“vľwg. It 15 formally true that u*v’wg = u*wgvľ, because multiplication 
is commutative. The problem is, that a tensor has only meaning for the user if one 
can, beforehand, assign meaning to each of the indices (i.e. "first index means this, 
second index means that...”). This will be confused if one mixes the indices up. 
Fortunately, in most applications of tensors the meaning of the indices will be clear 
from the context. Often symmetries of the indices will help in avoiding confusion. 
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6.4 First order derivatives: non-covariant version 


6.3. Tensor products 


The most important property of the product between two tensors is: 


The result of a product between tensors is again a tensor if in each summation 
the summation takes place over one upper index and one lower index. 


According to this rule, the following objects are therefore not tensors, and we will 
forbid them from now on: 
xp, HR (6.10) 


The following products are tensors, 
xr. Mp lafy (6.11) 
and the following expression is a covariant expression: 
p" = aP gbg. (6.12) 


If we nevertheless want to sum over two covariant indices or two contravariant 
indices, then this is possible with the use of the metric tensor. For instance: an inner 
product between t” en v” could look like: 


wh = zapt tof. (6.13) 


The metric tensor is then used as a kind of ‘glue’ between two indices over which 
one could normally not sum because they are of the same kind. 


6.4. First order derivatives: non-covariant version 


Up to now we have mainly concerned ourselves with the properties of individual 
tensors. In differential geometry one usually uses tensor fields, where the tensor 
depends on the location given by X. One can now take the derivative of such tensor 
fields and these derivatives can also be denoted with index notation. We will see in 
Chapter 7 that in curved coordinates or in curved manifols, these derivatives will 
not behave as tensors and are not very physically meaningful. But for non-curved 
coordinates on a flat manifold this problem does not arise. In this section we will 
therefore, temporarily, avoid this problem by assuming non-curved coordinates on 
a flat manifold. 
We start with the gradient of a scalar field, which we already know, 


(grad f), = LA (6.14) 


In a similar fashion we can now define the ‘gradient’ of a vector field: 


P до” 
(grad 3)", = ==, (6.15) 
or of a tensor-field, 
дїн 
(grad Ё) uva = Эхе . (6.16) 


As long as we employ only linear transformations, the above objects are all tensors. 
Now let us introduce an often used notation, 
дон 


o, дуо! = CE (6.17) 
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6.5 Rot, cross-products and the permutation symbol 


For completeness we also introduce 


9o" 
он ;— gpl := g"P—— , 6.18 
& "зур (6.18) 
With index notation we can also define the divergence of a vector field (again all 
under the assumption of non-curved coordinates), 


доб 


VED 


= дро? = о? р. (6.19) 
Note, just to avoid confusion: the symbol V will be used in the next chapter for a 
more sophisticated kind of derivative. We can also define the divergence of a tensor, 


aT*b 
AS Hr ee quf s. (6.20) 


6.5. Rot, cross-products and the permutation symbol 


A useful set of numbers, used for instance in electrodynamics, is the permutation 
symbol e. It is a set of numbers with three indices, if we work in a 3-dimensional 
space, or п indices if we work in n-dimensional space. 

The object e does not transform entirely like a tensor (though almost), and it is 
therefore not considered a true tensor. In fact it is a tensor density (or pseudo tensor), 
which is a near cousin of the tensor family. Tensor densities transform as tensors, but 
are additionally multiplied by a power of the Jacobian determinant of the transfor- 
mation matrix. However, to avoid these complexities, we will in this section assume 
an orthonormal basis, and forget for the moment about covariance. 

The € symbol is completely anti-symmetric, 











Eijk = —€jik = —€ikj = —€kji. (6.21) 


If two of the three indices have then same value, then the above equation clearly 
yields zero. The only elements of e that are non-zero are those for which none of the 
indices is equal to another. We usually define 


€123 — 1 , (6.22) 


апа with Eq. (6.21) all the other non-zero elements follow. Any permutation of in- 
dices yields a —1. As a summary, 


1 if ijk is an even permutation of 123, 
Eijk = 4 —1 if ijk is an odd permutation of 123, (6.23) 
0 if two indices are equal. 


This pseudo-tensor is often called the Levi-Civita pseudo-tensor. 
The contraction between two epsilons yields a useful identity, 


ЄхнүЄхрє = биодус S биедур . (6.24) 
From this it follows that 
ЄхвүЄхВє = 20,0, (6.25) 
апа also 
€aBy€nBy —6. (6.26) 
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With the epsilon object we can express the cross-product between two vectors 7 
and b, 


C—üxb — Cj — € jx Aj DK . (6.27) 
For the first component of c one therefore has 
Cy = €1jkl jbk = €12342b3 + €13243b2 = a2b3 — Бойз, (6.28) 


which is indeed the familiar first component of the cross-product between а and b. 
This notation has advantages if we, for instance, want to compute the divergence 
of a rotation. When we translate to index notation this becomes 


с= У. (V x d) = Vi(eijik V jar) = Eijkðið jak , (6.29) 
because : 
к 9 
V= || andtherefore У; = xl (6.30) 
ә 1 
TA 


On the right-hand-side of Eq. (6.29) one sees the complete contraction between a set 
that is symmetric in the indices 7 and j (9;9;) and a set that is antisymmetric in the 
indices і and j (єр). From the exercise below we will see that such a contraction 
always yields zero, so that we have proven that a divergence of a rotation is zero. 
> Exercise 4 of Section CA. 

One can also define another kind of rotation: the generalised rotation of a covector, 


(rot @) ap = da Wp = deit, ; (6.31) 


This transforms as a tensor (in non-curved coordinates /space) and is anti-symmetric. 
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Covariant derivatives 


One of the (many) reasons why tensor calculus is so useful is that it allows a proper 
description of physically meaningful derivatives of vectors. We have not mentioned 
this before, but taking a derivative of a vector (or of any tensor for that matter) is 
a non-trivial thing if one wants to formulate it in a covariant way. As usual, in a 
rectangular orthonormal coordinate system this is usually not an issue. But when 
the coordinates are curved (like in polar coordinates, for example) then this becomes 
a big issue. It is even more of an issue when the manifold is curved (like in general 
relativity), but this is beyond the scope of this booklet — even though the techniques 
we will discuss in this chapter will be equally well applicable for curved manifolds. 

We want to construct a derivative of a vector in such a way that it makes physical 
sense even in the case of curved coordinates. One may ask: why is there a problem? 
We will show this by a simple example in Section ??. In this section we will also 
show how one defines vectors in curved coordinates by using a local set of basis 
vectors derived from the coordinate system. In Section ?? we will introduce without 
proof the mathematical formula for a covariant derivative, and introduce thereby 
the so-called Christoffel symbol. In Section ?? we will return to the polar coordinates 
to demonstrate how this machinery works in practice. 

This chapter will, however, take quite large steps. The reason is that the concepts 
of covariant derivatives are usually described in detail in introductory literature 
on general relativity and Riemannian geometry. In principle this is well beyond 
the scope of this booklet. However, since tensors find much of their application in 
problems in which differential operators are used, we wish to at least briefly address 
the concept of covariant derivative. For further details we refer to 'PPPeeeeeeeeeeer 
LITERATURE LIST SESESEOE SEE OE SEE E SEO EE 


7.1. Vectors in curved coordinates 


Defining vectors in curvilinear coordinates is not trivial. Since the coordinates are 
curved (maybe even the manifold itself is curved, like the surface of the Earth), there 
is no meaningful global set of basis vectors in which one can express the vectors. If 
a vector or tensor field is given, then at each location this vector or tensor could 
be decomposed into the local basis (co-)vectors. This basis may be different from 
location to location, but we always assume that the changes are smooth. 

In principle there are two useful set of basis vectors one can choose: 


1. A local orthonormal set of basis vectors: If the coordinates are such that they are 
locally perpendicular with respect to each other, then it is possible to choose 
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the basis vectors such that they point along these coordinates (though not nec- 
essarily are normalized the same as the coordinate units). 


2. A local coordinate basis: The covector basis can be seen as unit steps in each of 
the directions: é = dx". The contravariant basis vectors are then €, = 0/oxt. 
Typically this coordinate basis is not orthonormal. 


So far in the entire booklet we have implicitly assumed a local coordinate basis (re- 
member that we used the words coordinate transformation on equal footing as basis 
transformation). For tensor mathematics this basis is usually the easiest to use. But 
in realistic applications (like in Chapter ??) a local orthonormal basis has more phys- 
ical meaning. In the application of Chapter ?? we will first convert everything to the 
coordinate basis in order to do the tensor math, and then, once the final answer is 
there, we will convert back to the local orthonormal basis, which is physically more 
intuitive. But since the tensor mathematics works best for the local coordinate basis, 
we will assume this basis for the rest of this chapter. 

Now let us take the example of circular coordinates in two dimensions. We can 
express the usual x- and y-coordinates in terms of r and pas: x = rcosp and y = 
rsing. In r-direction the coordinate basis vector d/dr can act as a normal basis 
vector. In the p-direction, however, the coordinate basis vector 0/0 has a different 
length at different radii. However, 19 /9ф is again a normalized (unit) vector. The 
set of basis vectors (9/07, д/9ф) is the local coordinate basis, while the set of basis 
vectors (9/97, 19/ 9$) is a local orthonormal basis, which happens to be parallel to 
the coordinates. 

Now let us use the coordinate basis. Let us take a vector field that, at every 
location, when expressed in this local basis, takes the form (1,0). This is shown in 
Fig. XXXX. Expressed in cartesian coordinates (for which a global basis is possible) 
this would be a vector field (x / /x? + y2, y/ ү/ x? + y*). Clearly this vector field is 
not constant. In cartesian coordinates one would write, for instance, 


9 fert {er (71) 
Әх WIVES) year ' 


which is clearly non-zero. However, if we switch to circular coordinates, апа take 
the derivative with respect to, for instance, ф, then we obtain zero, 


30-0. s 


In the circular coordinate system it looks as if the vector does not change in space, 
but in reality it does. This is the problem one encounters with derivatives of tensors 
in curved coordinates. Going to the local orthonormal basis does not help. One has 
to define a new, ‘covariant’ form of the derivative. 





7.2. The covariant derivative of a vector/tensor field 


In this section we will introduce the covariant derivative of a vector field. We will 
do so without proof. Again, for a more detailed discussion we refer to the literature. 
We define d, to be the ordinary coordinate-derivative 90/0x", and V to be the new 
covariant derivative. The covariant derivative of a vector field v" is defined as 


Уро" = дро" Гро", (7.3) 


where I7, is an object called the Christoffel symbol. The Christoffel symbol is not 
a tensor because it contains all the information about the curvature of the coordi- 
nate system and can therefore be transformed entirely to zero if the coordinates are 
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straightened. Nevertheless we treat it as any ordinary tensor in terms of the index 
notation. 

The Christoffel symbol can be computed from the metric guy (and its companion 
^P) in the following way, 


га — los den, | dën ` dër 
wy 98 \ Oye aw Әх 











= Se" (gout Sour Swf) TA 
The covariant derivative of a covector can also be defined with this symbol, 
Мий = дн — Tav. (7.5) 
The covariant derivative of a tensor t^P is then 
Vy = др? Га 8 + Th m, (7.6) 


and of a tensor t“ В, 





Vats = Out в E Diog = Piste . (7.7) 


» NOW MAKE EXERCISES TO SHOW WHAT HAPPENS WITH THE ABOVE EX- 
AMPLE 


From the exercise we can see that the above recipe indeed gives the correct an- 
swer even in curved coordinates. We can also prove that the covariant derivative of 
the metric itself is always zero. 


» ANOTHER EXERCISE 


The covariant derivative Vy produces, as its name says, covariant expressions. 
Therefore Vt", is a perfectly valid tensor. We can also contract indices: MATT, 
or with help of the metric: 2^" V4t/"^. Since Vugap = 0 (as we saw in the above 


exercise) we can always bring the g,g and/or 4^? inside or outside the V, operator. 
We can therefore write 


STEE — Valt at) — vi, UR (7.8) 


We can also define: 
V* = фур (7.9) 
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Tensors in special relativity 


Although tensors are mostly useful in general relativity, they are also quite conve- 
nient in special relativity. Moreover, when we express the formulas using tensors, 
they expose the structure of the theory much better than the formulas without ten- 
sors do. We will start here at the point when four-vectors are introduced into special 
relativity. 

From the simple thought experiments with moving trains, meant to give a visual 
understanding of the Lorentz transformations, it has become clear that 3-dimensional 
space and 1-dimensional time are not separate entities, but rather should be seen as 
one. In matrix form one found for a pure Lorentz transformation 


x 0 
, y —yB 0 0 j 
x! —ypB y 00 x 
x2 | 0 0 10 y^^ Be 
gi 0 0 0 1 y? 


with y = 1/ v1 — 02/с2 and B = 2. Moreover, we found that the inner product now 
satisfies the somewhat strange formula 





(ӣ, Б) = —a°b® + ad! + ab? + abò. (12) 


With the knowledge which we now have about the ^metric tensor', this formula сап 
be understood much better. Namely, we know that the inner product of two vectors 
does not really exist (at least not in a form which is independent of the coordinate 
system). Rather, we should be talking about the inner product of a vector with a 
covector. We can obtain one from the other by raising or lowering an index, making 
use of the metric tensor, 

а = ава? . (1.3) 


Eq. (1.2) should thus really be viewed as 
(à, D), = a" b, = guva b" . (14) 


where P is a covector. From the fact that inner products such as (1.2) are invariant 
under Lorentz transformations we now find the components of the metric tensor, 


—1 00 0 
0 100 

Suv — 0 010 (1.5) 
0 00 1 
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Minkowski space, which is the space in which the rules of special relativity hold, is 
thus a space which has a metric which is different from the metric in an ordinary 
Euclidean space. In order to do computations in this space, we do not have to in- 
troduce any strange inner products. Rather, we simply apply our new knowledge 
about inner products, which automatically leads us to the modified metric tensor. 

Let us end with a small related remark. We have seen in Chapter (5) that the 
metric can also be used to describe curved spaces. The Minkowski metric which we 
have encountered in the present section can be used to describe curved space-time. 
This concept is at the basis of the general theory of relativity. In that theory, gravity 
is explained as a consequence of the curvature of space-time. A good introduction 
to this theory is given in [5]. 
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Geometrical representation 


The tensors as we have seen them in the main text may appear rather abstract. How- 
ever, it is possible to visualise their meaning quite explicitly, in terms of geometrical 
objects. A simple example of this is the arrow-vector. An arrow-vector is effectively 
just a set of numbers that transforms in a particular way under a basis transforma- 
tion. However, it is useful to think about it in terms of an arrow, so as to visualise 
its meaning. 

We can make a similar geometrical visualisation of a covector, as well as for all 
other tensors. The present appendix contains a list of these geometrical representa- 
tions. As we go along we will also describe how various manipulations with tensors 
(such as additions and inner products) can be translated to this geometrical picture. 
None of this is necessary in order to be able to compute with tensors, but it may 
help in understanding such computations. 


e arrow-vector 


An arrow-vector is represented by (how else) an arrow in an n-dimensional 
space. The components of the vector (i.e. the numbers v”) are obtained by 
determining the projections of the arrow onto the axes. See figure B.1. 








Figure B.1: Geometrical representation of a vector, and the determination of its com- 
ponents by projection onto the axes. 


e co-vector 


A co-vectors is closely related to the gradient of a function f(X), so it makes 
sense to look for a geometrical representation which is somehow connected 
to gradients. A useful related concept is that of contour lines (curves of equal 
height, in two dimensions) or contour surfaces (in three dimensions). Now 
consider two consecutive contour lines. The intersection they make with a 
neighbouring x? — constant lijne is equal to the increase of x! necessary to 
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increase f(X) by 1, if the other coordinate is kept constant. So in two dimen- 
sions, 


1 E 
intersection at xl-axis — (5) = (35) (2.1) 
of x2 constant dr 


x? constant 


Therefore, if we take the inverse of this intersection, we again obtain the first 
component of the gradient. 


Given the above, it makes sense to use, for the generic representation of a 
co-vector, two consecutive lines (or, in three dimensions, planes), such that 
the intersections with the axes are equal to the components of the co-vector. 
Note that one should also keep track of the order of the lines or planes. In the 
representation sketched in figure B.2 we have drawn a flexible type of arrow. 
This is not an arrow-vector as above, but only meant to indicate the order of 
the surfaces. We could equally well have labelled the surfaces with different 
numbers or colours. 






——  asafsnede 


5 





Figure B.2: Geometrical representation of a co-vector, and the determination of its 
components by computing the inverse of the intersection with the axes. 


anti-symmetric contravariant second-order tensor HIT 


An anti-symmetric contravariant second order tensor can be made from two 
vectors according to 
t" = vw’ — who". (2.2) 


This is a bit like an outer product. The order of the two vectors is clearly 
of relevance. We can visualise this object as a surface with a given area and 
orientation. The components of the tensor can be obtained by measuring the 
projection of the surface onto the various coordinate surfaces. A negative com- 
ponent is obtained when the orientation of the surface assocatiated to the ten- 
sor is negative. Let us illustrate this with an example: if the surface of the 
projection on the xt, x? surface is equal to 2, then the t!? component equals 2 
and the Р! component equals —2. See figures В.З and BA. 


Figure B.3: Representation of an anti-symmetric contravariant 2nd-order tensor. 


e anti-symmetric covariant second order tensor tuy 


This object can again be seen as a kind of outer product of two vectors, or 
rather two co-vectors, 
tuv = VyWy — Wydy . (2.3) 
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Figure B.4: Determination of the components of an anti-symmetric contravariant 
second order tensor. 


We can visualise this object as a kind of tube with an orientation. The compo- 
nents can be found by computing the intersections of this tube with all coor- 
dinate surfaces, and inverting these numbers. Again one has to keep track of 
the orientation of the intersections. See figure B.5. 


— > 





Figure B.5: Geometrical representation of an anti-symmetric covariant second order 
tensor. 


addition of vectors 


Addition of vectors is of course a well-known procedure. Simply translate one 
arrow along the other one until the top. This translated arrow now points to 
the sum-arrow. See figure B.6. 


Figure B.6: Geometrical representation of the addition of vectors. 


addition of co-vectors 


The addition of covectors is somewhat more complicated. Instead of trying to 
describe this in words, it is easier to simply give the visual representation of 
this addition. See figure for a two-dimensional representation. 


inner product between a vector and a co-vector 


The inner product of a vector and a co-vector is the ratio of the length of the in- 
tersection which the co-vector has with the vector and the length of the vector. 
See figure B.8 for a three-dimensional representation. 
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Figure B.7: Geometrical representation of the addition of co-vectors. 


Figure B.8: Representation of the inner prdouct between a vector and a co-vector. 


e second order symmetric co-variant tensor Suv 


The metric tensor belongs to this class. It therefore makes sense to look for 
a representation which is related to the inner product. A suitable one is to 
consider the set of all points which have a unit distance to a given point Xo, 


{22183 | saxa =1}. (2.4) 
If the metric is position-dependent, g = g(x), then the point Xo is equal to the 


point at which the corresponding metric gy, is evaluated. 


Now it is also clear what is the connection to the ellipses of chapter 5. See 
figure B.9 for a three-dimensional representation: an ellipsoid. 


Figure B.9: Geometrical representation of a second order symmetric covariant ten- 
sor. 


It is considerably more complicated to make a geometrical representation of a 
second order symmetric contravariant tensor, so we will omit that case. 
e turning an arrow-vector into a co-vector 


The procedure of converting a vector to a co-vector can also be illustrated ge- 
ometrically, see figure B.10 for a two-dimensional representation. The two 
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long slanted lines are tangent to the circle, and the bottom horizontal line 
goes through the center of the circle. This representation fails when the arrow- 
vector is shorter than the radius of the circle. 











2 


Figure B.10: Geometrical representation of turning ап arrow-vector into а co-vector. 
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Exercises 


C.1. Index notation 


1. A, B and C are matrices. Assume that 
А = BC 
Write out this matrix multiplication using index notation. 


2. A and B are matrices and x is a position vector. Show that 


n 


n n n 
у Anal A. ByaXx) = у pA Ay BvaXw) 
v=1 a=1 


v=la=1 


п п 


= ER. Vë (Aj BuaXa) 


&=1v=1 


n 


= (6 Genda 


a=1 v=1 
3. Which of the following statements are true? 
(a) The summation signs in an expression can always be moved to the far 
left, without changing the meaning of the expression. 


(b) If all summation signs are on the far left of an expression, you can ex- 
change their order without changing the meaning of the expression. 


(c) If all summation signs are on the far left of an expression, you cannot just 
change the order of the variables in the expression, because this changes 
the order in which matrices are multiplied, and generically AB # BA. 


(d) Аш = (AD 
(e) Aw = (АТ) 


4. A, B, C, D and E are matrices. Write out the following matrix multiplications 
using index notation (with all summation signs grouped together). 


(a) 
= B(C+D) 


(b) 
A — BCD 
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10. 


(c) 
A — BCDE 


Assume you have three vectors X, Ў and Z which satisfy the following relations, 


BX 


SL 
|| 


NI 


Write these relations using index notation. Now write down the relation be- 


tween Z and X using index notation. 


Write in matrix form 
n n 


Dg, =}, dn Banten 
ul a=1 


Try a couple of the previous exercises by making use of the summation con- 
vention. 


Write as a matrix multiplication: 


(a) 
Dag = Any BuvCpy 


(b) 
Dap = AnpBpyCuy 


(c) 
Dag = Aar (Bag + Сур) 


. Consider a vector field in an n-dimensional space, 


U(X). 
We perform a coordinate transformation, 
x = AX А isa transformation matrix. 


Show that 
v = Аб, 


where the matrix А is the same matrix as in the first equation. 


For a transformation we have 
x = АХ. 


This corresponds to 
п 
x = У Арх. 
v=1 
Can you understand the expression 
п 

Yo xyApy =? 

v=1 
And how can you construct the matrix multiplication equivalent of 


п 
E хрАру =? 
gel 


(note the position of the indices). 


C.3 Introduction to tensors 


C.2. Co-vectors 


1. The matrix for a rotation over an angle ¢ in the x-y plane is given by 
д = { © $ sing 
^ \=sing созф/` 
Compute the inverse of this matrix (either by replacing ф by —$ or by matrix 
inversion). Show that (A~!)? is equal to A. 
2. In Cartesian coordinate systems the basis vectors are orthogonal to each other, 
ё: = 0. 


(This is a somewhat misleading notation. You might be tempted to interpret 
this as the inner product of two basis vectors, in which the components of the 
basis vectors are expressed in the basis itself. That would of course always 
yield a trivial zero). 


If we transform from one such Cartesian coordinate system to another one, 
& = Ла & ё = AD, 


(where Л is the transformation matrix) then this relation should of course con- 
tinue to hold, 

& -&' =0. 
Insert the transformation rule given above and show that, for transforma- 
tions between two Cartesian systems, the tranformation matrix A is equal 
to (A-1)T. These are thus orthogonal transformations. 


C.3. Introduction to tensors 


1. With the help of various mathematical operators you can make new tensors 
out of old ones. For instance 


Uy = tvv’ n 
in which ty, and v" are tensors. 
(a) Show that in this case w, is also a tensor (that is, show that it transforms 


correctly under a basis transformation). 
(b) Show that w” is not a tensor if we make it according to 
wt = Hu". 

2. A matrix can be viewed as an object which transforms one vector into another 
one. We have seen that this can be a normal transformation or a basis transfor- 
mation. The question is now: does a normal transformation matrix transform 
too upon a change of basis. And how? Write this out in normal matrix no- 


tation, with S the matrix which transforms from the original system to the 
primed system, and A the matrix which is to be transformed. 


Hint: 
у= Ах, 
and after a basis (or coordinate) transformation 
Аў = S(Ax), 
but there is also a matrix A’ which satisfies 


Sij = A'(Sx). 
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3. Show that, if you start with a number of tensors and construct a new object 
out of them, and use the summation convention (that is, only sum over one 
upper and one lower index, never over two indices at the same position), the 
new object is again a tensor. 


C.4. Tensoren, algemeen 
1. You have seen that there are four types of 2nd-order tensors. How many 3rd 
order tensors are there? 


2. Take an anti-symmetric tensor Р”. Show that the property of anti-symmetry 
is preserved under a basis transformation. Do the same thing for a symmetric 
tensor. This shows that symmetry and anti-symmetry are fundamental prop- 
erties of tensors. 


3. Show, by writing out the transformation of a (1, 1)-tensor, op te schrijven, dat 
het geen zin heeft om te spreken van symmetrie of anti-symmetrie van een 
tensor in indices die niet van hetzelfde soort zijn. (Laat dus zien dat die eigen- 
schap na transformatie meestal verloren is). 


4. Gegeven een tweede orde contravariante symmetrische tensor t en een tweede 
orde covariante antisymmetrische tensor r. Toon aan dat de dubbele contractie 


Prag 
altijd gelijk is aan nul. 
5. De vogende tensor is gedefinieerd uit twee vectoren: 
tH = vw — qw" 
Laat zien dat deze antisymmetrisch is. 


6. Hoe transformeert een kronecker-delta? De kronecker-delta is symmetrisch; 
waarom blijft de eigenschap van symmetrie hier wel behouden, terwijl toch is 
bewezen dat de symmetrie in een boven en onderindex niet behouden blijft? 


7. We hebben in opgave 2 in paragraaf C.3 gezien hoe een matrix A transformeert. 
Laat aan de hand daarvan zien hoe de matrix AT transformeert. Toon аап de 
hand van de twee gevonden vergelijkingen aan dat het object g uit de tekst 
niet transformeert als een matrix, maar ook niet als de getransponeerde van 
een matrix. 


8. Neem twee tensoren: sf" en tuy. Maak een product van die twee dat 


(a) geen vrije indices heeft. 
(b) twee vrije indices heeft. 


(c) vier vrije indices heeft. 


9. Hoe transformeert een 3° orde geheel covariante tensor? Kan dit in matrixvorm 
geschreven worden? 


10. Je kunt een niet-lineaire coórdinatentransformatie geven door de nieuwe coördinaten 
uit te drukken als een functie van de oude coördinaten: 


x" e fal, x aax") 


y" = faxa. unt) 


50 


Cp Tensor calculus 


Deze functies zijn nu naar hun п coórdinaten te Taylor-ontwikkelen om het 
punt 0. Maak zo’n Taylor-ontwikkeling. 


Aanwijzing: 
Bij het afleiden van de Taylorreeks van een gewone functie ging men uit van 
een eenvoudige machtreeks: 


f(x) = ag + aix + пох? + азхэ... 


Door deze vergelijking steeds te differentiëren kon men de coëfficienten 49... 
bepalen. Doe iets dergelijks ook in dit geval. 


C.5. Metrische tensor 


1. Laat zien dat het onmogelijk is om een metrische tensor die zowel 1’en als 
—1'еп op de hoofddiagonaal heeft, te transformeren naar een vorm waarin er 
nog uitsluitend 1’en aanwezig zijn. 

2. Het nieuwe inproduct, met de metrische tensor, is invariant onder coördina- 
tentransformaties: 


A = Syyxtx! 


Bij de behandeling van de Speciale Relativiteitstheorie komen we echter ook 
vaak de volgende vergelijking tegen: 


бл" — goyala” 


(dus zonder accent bij g) Leg uit waarom we deze vergelijking mogen ge- 
bruiken in alle gevallen dat g de Minkowskimetriek is en we uitsluitend in 
lorentzframes werken. 
C.6. Tensor calculus 
1. Bewijs dat de volgende vergelijkingen covariant zijn: 
2®В — ypa 
z^P = xp + уб“ 


2. Stel, je hebt 2 berekeningen uitgevoerd: 


en 


Hoe kan je nu, terwijl de indices van x en y verschillend zijn, toch deze twee 
vectoren optellen? 


3. Waarom is het bij 





8 до! 
(grad2)", = ERE 
niet nodig om de indices (aan de linkerkant van de vergelijking) op volgorde 


te zetten? 
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